Nonparametric tests for transition probabilities in nonhomogeneous Markov processes
نویسندگان
چکیده
منابع مشابه
Loss Bounds for Uncertain Transition Probabilities in Markov Decision Processes
We analyze losses resulting from uncertain transition probabilities in Markov decision processes with bounded nonnegative rewards. We assume that policies are pre-computed using exact dynamic programming with the estimated transition probabilities, but the system evolves according to different, true transition probabilities. Our approach analyzes the growth of errors incurred by stepping backwa...
متن کاملBayesian Nonparametric Inference for Nonhomogeneous Poisson Processes
Several classes of nonparametric priors are employed to model the rate of occurrence of failures of the nonhomogeneous Poisson process used in software reliability or in repairable systems. The classes include the gamma process prior, the beta process prior, and the extended gamma process prior. We derive the posterior distribution for each process. Sampling based methods are developed for Baye...
متن کاملAsymptotically Optimal Sequential Tests for Nonhomogeneous Processes
It is shown that under certain conditions the matrix sequential probability ratio test (SPRT) and the combinations of \rejecting" SPRTs minimize all moments of the stopping time distribution in the problem of sequential testing of several simple hypotheses for nonhomogeneous processes when probabilities of errors tend to zero. We consider the general case of observation process with discrete or...
متن کاملAverage Cost Markov Decision Processes with Weakly Continuous Transition Probabilities
This paper presents sufficient conditions for the existence of stationary optimal policies for averagecost Markov Decision Processes with Borel state and action sets and with weakly continuous transition probabilities. The one-step cost functions may be unbounded, and action sets may be noncompact. The main contributions of this paper are: (i) general sufficient conditions for the existence of ...
متن کاملFactored Markov decision processes with Imprecise Transition Probabilities
This paper presents a short survey of the research we have carried out on planning under uncertainty where we consider different forms of imprecision on the probability transition functions. Our main results are on efficient solutions for Markov Decision Process with Imprecise Transition Probabilities (MDP-IPs), a generalization of a Markov Decision Process where the imprecise probabilities are...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Nonparametric Statistics
سال: 2019
ISSN: 1048-5252,1029-0311
DOI: 10.1080/10485252.2019.1705298